The judging aspect is what I don't like about it as well. You have to keep in mind that most events are not competitions. Its kinda like hot lapping on a road course. You're not competeing, you're trying to get better and have fun while doing it.
I think what gets misunderstood is that a small minority of drift events are competitions.